Digital watermark systems and methods

ABSTRACT

A digital watermark is added to audio or visual content. An illustrative embodiment segments the content, permutes the segments, and transforms such data into another domain. The transformed data is altered slightly to encode a watermark. The altered data can then be inverse-transformed, and inverse-permuted, to return same to substantially its original form. Related watermark decoding methods are also detailed, as are ancillary features and techniques.

RELATED APPLICATION DATA

This application is a division of copending application Ser. No.09/367,797, filed Jan. 19, 2000, which is a U.S. nationalization of PCTapplication PCT/AU98/00106, filed Feb. 20, 1998, which claims priorityto Australian application PO5218/97, filed Feb. 20, 1997. Priority tothese applications is claimed under 35 USC §§119 and 120. These priorapplications are incorporated herein by reference.

SPECIFICATION

The present technology relates to the provision of identification orauthentication data, sometimes referred to as a watermark or signature,in digital media data such as digital image or audio data. Inparticular, this technology relates to a method and apparatus forincorporating a watermark in digital media data, and a method andapparatus for retrieving or extracting a watermark from digital mediadata in which a watermark has been previously incorporated.

In this specification the term “watermark” is used to refer to anydistinctive or distinguishing data which may be used for identificationor authentication of the digital media data associated therewith, or ofsome attribute of the media data such as the source thereof. A watermarkmay comprise image data, such as pixel data forming a logo or the like,or may be in the form of coded text and/or binary numbers, for example,which represent a message. In some applications the watermark data mayinclude error correction coding techniques to improve the robustness ofthe watermark to image manipulation. The format of the signal that is tobe watermarked is not restricted to a multi dimensional representation.It is also possible for audio information to be watermarked. This methodof encoding data is not restricted to information associated withcopyright and could be used to convey any suitable information in ahidden manner.

Watermarks are utilised in media data for a number of reasons, one beingto prevent or discourage copying of the media data if it is subject tocopyright, or to at least allow for identification of the media dataeven if it is copied. Visible watermarks have been employed for manyyears in varying applications including banknotes and photographs, buthave significant disadvantages because of their visible nature. Althougha visible watermark may be quite effective in discouraging copying of anassociated image, in general it is considered disadvantageous for awatermark to be obtrusive upon the original image.

Besides the issue of whether or not the watermark is visible in anassociated image (or audible in the case of watermarked audio media),several other factors may also be considered important.

For example, the watermark should usually be robust to manipulation ofthe watermarked media, and desirably should be secure so as to not beeasily removable by a malicious user. Before the advent of digital mediaprocessing and manipulation, a degree of robustness and security wasinherent in a visible watermark, because a copy of the watermarked imagewould generally bring with it the visible watermark itself which wouldbe difficult to remove. However, digital processing makes it possible toperform many sophisticated manipulative operations on watermarked media,which may degrade the visible watermark or be utilised to alter an imageto at least substantially remove the watermark. In this case, therefore,the properties of a visible watermark count against the security thereofsince it is clearly visible what must be removed or altered in thewatermarked image. A paper entitled “Protecting publicly-availableimages with a visible image watermark” (Braudaway, et al, SPIE Vol.2659, pp 126-133) discusses robustness and security in visible imagewatermarks.

Visible watermarks are considered unsuitable for many modernapplications because of the intrusive effect of the watermark on theoriginal media. Watermarking schemes have been developed in which thewatermark is substantially invisible on an original image but readilyvisible on a copy thereof. However, such schemes generally rely uponcharacteristics of photocopying or electronic scanning apparatus, and soare only suitable for a limited range of applications, such as in imagesor text on paper documents. In any event, these watermarking schemes arealso subject to security difficulties arising from digital processingand manipulation.

In media involving a sequence of images, such as video media, it isparticularly undesirable for a watermark to be intrusively visible,since considerable effort is expended in providing the image data to theuser in a form which is as visually clear as possible, and a visiblewatermark may significantly detract from the original image. Visiblewatermarks are presently used in some video applications, particularlytelevision coverage of live sporting events where a relatively small andfaint logo or the like is superimposed on the television picture,typically near one corner thereof. This is not completely satisfactory,besides the visual intrusion, because the logo can be easily croppedfrom the picture in a copy thereof, or could be relatively easilyremoved, at least substantially, with digital processing techniques. Tomake the visible watermark more secure it should be placed over thevisually most important part of the image, which also makes thewatermark more intrusive and thus less desirable.

Invisible watermarking techniques, particularly for digital media data,have been developed, and one is described in an article entitled“Watermarking Digital Images for Copyright Protection” (J. J. K.O'Ruanaidh, F. M. Boland & O. Sinnen). This article discloses a methodof embedding a watermark in a digital image which is said to beinvisible and quite robust.

The image data is divided into rectangular blocks, and each block isthen transformed using either a Walsh transform, discrete cosinetransform (DCT) or wavelet transform. The bits defining the watermarkgraphic are inserted in the digital image by incrementing ordecrementing a selected coefficient in the transform domain of the datablock. Coefficients are selected according to a criterion based onenergy content. Another algorithm described in the article relates toinsertion of watermark data based on the use of the discrete Fouriertransform (DFT). This method differs fundamentally from the transformdomain technique outlined above. The DFT is a complex transform thatgenerates complex transform domain coefficients given a real valuedinput. The watermark is placed in the phase component of generatedtransform coefficients when using this transform.

Another article which addresses the difficult issues of digitalwatermarking is “Secure Spread Spectrum Watermarking for Multimedia”(Cox, et al, NEC Research Institute, Technical Report 95-10). Thisarticle describes an invisible digital watermarking method for use inaudio, image, video and multimedia data.

The method described in this article also involves a frequency domaintransform of the image data and insertion of the watermark data whilstin the transform domain. In practice, in order to place a length nwatermark into an N×N image, the discrete cosine transform of the imageis computed, and the watermark data encoded into the n highest magnitudecoefficients of the transform matrix, excluding the dc component.

The watermarking techniques of O'Ruanaidh et al and Cox et al requirethe original image when performing the watermark extraction operation.As a consequence, proof of ownership is accomplished only if theoriginal image is certified as being the original by a trusted thirdparty, and the particular segment of the original image must be firstidentified and found before ownership is verified.

The technology detailed herein addresses some of the difficultiesidentified in the prior art.

As detailed more fully below, an exemplary method for inserting datainto digital media data may include:

-   -   segmenting the digital media data into data blocks;    -   applying a pseudo-random reversible function to a block of the        digital media data to obtain a modified data block;    -   applying an orthogonal transform on the modified data block to        obtain transform domain data;    -   modifying at least one selected transform domain data        coefficient in accordance with identification or authentication        data;    -   inverse transforming the transform domain data having the at        least one modified coefficient; and    -   applying an inverse pseudo-random function to obtain watermarked        digital media data.

The pseudo-random reversible function can have the property offlattening the power spectral density of the data block (i.e., thefunction performs a spectral whitening operation), such that eachcoefficient then generated by the transform contributes substantiallyequally to the total energy of the block. This allows the watermarkingprocess to be less sensitive, with regard to introduced distortion, tothe selection of the transform coefficient which is modified in thewatermark insertion operation.

As detailed more fully below, an exemplary method for extracting datafrom watermarked digital media may include:

-   -   segmenting the digital media data into data blocks;    -   applying a pseudo-random reversible function to a block of the        digital media data to obtain a modified data block;    -   applying an orthogonal transform to the modified data block to        obtain transform domain data; and    -   extracting identification or authentication data from at least        one coefficient of the transform domain data.

The insertion and/or extraction method can be performed in real time,which is particularly advantageous when the digital media data haspresentation timing restrictions, such as in the case of real time videoand/or audio data.

The average (dc) component of the transformed media data can berestricted to a single known transform coefficient and that thistransform coefficient is not available for modification by the watermarkinsertion operation. The pseudo-random reversible function can betolerant to the introduction of noise resulting from signal processingthat could subsequently be performed on the watermarked media data. Manydifferent pseudo-random functions could be used for this application.One pseudo-random function that offers good performance in terms of itsnoise rejection capability, spectral flattening performance andsimplicity of implementation is a permutation of the data block basedupon a keyed random number generator. In that case, the user desirablyshould ensure that a permutation is selected that exhibits the desiredspectral whitening characteristics, as this is not guaranteed by allpermutations.

A number of different transforms exist that could be used as theorthogonal transform operation. These include the Walsh HadamardTransform (WHT), Discrete Cosine Transform (DCT), Discrete SineTransform (DST) and Fast Fourier Transform (FFT). As noted, the WalshHadamard Transform often provides low implementation complexity. The ACtransform coefficients generated with such a transform in conjunctionwith an appropriate pseudo-random function, using real image data asinput, are characterised by all possessing approximately equal energy.The selection of transform coefficient(s) for modification can thus bebased on a random keyed operation to further enhance the security of thewatermark.

For functions and transforms that do not restrict the average value ofthe data block to a single transform coefficient, the average (dc) valuefor the data block can be calculated, stored, and subtracted from eachdata value in the data block prior to the application of the of thepseudo-random function (this reduces watermark visibility). The averagevalue is subsequently retrieved and added to each data value making upthe watermarked data block immediately after the application of theinverse pseudo-random function.

The application of the pseudo-random function and the application of theorthogonal transform can be combined into a single operation. Similarlywith respect to the inverse pseudo-random function and inversetransform. A combined data permutation and transform operation can beconsidered equivalent to, in the one dimensional case, performing apermutation upon the columns making up the basis matrix of the transformin question. Each permutation will yield an orthogonal transform, hencethe number of transforms contained in the set is equal to the number ofavailable permutations. Using this interpretation, the security of thewatermark relies not just on which transform coefficient has beenmodified to contain the watermark data, but also on which member of theset of available transforms has been used.

Yet another embodiment provides apparatus for inserting or extractingwatermark data in digital media data, comprising:

segmenting means for segmenting the digital media data into data blocks;processing means for applying a pseudo-random reversible function to ablock of the digital media data to obtain a modified data block andperforming a transform on the modified data block to obtain transformdomain data; and means for inserting or extracting watermark data in atleast one coefficient of the transform domain data.

In the case where watermark data is to be inserted in the digital mediadata, the processing means can be adapted to perform an inversetransformation and inverse pseudorandom function on the transform domaindata containing the watermark data so as to obtain watermarked digitalmedia data.

In practice, the segmenting of the digital media data into data blocksmight comprise forming blocks of 64×64 pixels of image luminance pixeldata, where the watermark is to be inserted into a still image or imagesequence. The block size need not be restricted to being square and ofdimension 64×64 pixels; both smaller and larger block sizes are possibledepending upon application requirements. In practice, theidentification/authentication data which is inserted into a data blockof digital media data might comprise a pixel from a binary graphic, ordata in the form of bits used to represent text and binary numbers, forexample. The watermark data is inserted into the data block that hasundergone a block transform operation. The distortion introduced due tothe insertion of watermark data is dependent upon the block size, thenumber of transform coefficients modified by the insertion operation,and the magnitude of the modification. The watermark data density perblock is arbitrary depending upon application requirements. In general,however, the higher the density the more visually noticeable is theinserted watermark in the image. A series of data blocks may becontained in a single image frame or spread over a number of imageframes.

A great variety of other arrangements and improvements are alsodetailed.

Certain embodiments detailed below have one or more of the followingadvantages:

-   -   1. the presence of the watermark is invisible (i.e., the        watermarked visual or audio material is visually or auditorially        substantially indistinguishable from the original);    -   2. the watermark is robust to signal manipulation and        distortion;    -   3. the watermark is secure;    -   4. the original media data is not required in order to extract        the watermark;    -   5. the watermark can be inserted and/or extracted by a simple        computational procedure which can be done in real time.

The foregoing and additional features and advantages of our technologywill be more readily apparent—by way of example only—from the followingdetailed description, which proceeds with reference to the accompanyingdrawings.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a flowchart illustrating exemplary operations for insertingwatermark data into digital media data;

FIG. 2 is a flowchart illustrating exemplary operations for extractingwatermark data from digital media data;

FIG. 3 is a diagram of an exemplary watermark insertion process;

FIG. 4 is a flowchart illustrating exemplary operations for a particularimplementation of a watermark insertion procedure;

FIG. 5 is a block diagram of an exemplary watermarking apparatus forreal-time video; and

FIG. 6 is a block diagram of an exemplary media monitoring system.

DETAILED DESCRIPTION

The technology detailed herein relates to the insertion and extractionof identification or authentication data for use as a watermark indigital media data, such as digital image data, still or sequential,digital audio data or the like. A watermark provided in digital mediadata may provide a means for identification of the source or some otherattribute of the media data as may be required to prove copyrightownership, for example. As mentioned above, embodiments detailed hereinmay have a number of advantageous properties, including:

the watermark presence being at least substantially invisible (i.e. thewatermarked visual or audio material is visually or auditoriallysubstantially indistinguishable from the original);

the watermark can be inserted and/or extracted by a simple computationalprocedure which can be done in real time for audio and/or video mediadata; and

the original media data not being required in order to extract thewatermark from the watermarked media data.

Additionally, as also discussed above, it is desirable for watermarks indigital media data to also be both secure in that a malicious usercannot easily remove or disguise the watermark so as to preventextraction, and robust to enable the inserted watermark to survivemanipulation of the watermarked media data. Digital images and imagesequences, for example, are seldom stored or transported over acommunications link in their raw format.

Frequently some form of compression may be applied to the media data,and it can therefore be important that the signal processing associatedwith the compression algorithm does not remove or wash out theassociated watermark inserted in the media data.

Although the following description refers primarily to still orsequential image data, it is to be understood that the technology isequally applicable to other forms of digital media data, such asdigitised audio data.

In an exemplary embodiment, image pixel data is subdivided into 64×64pixel spatial domain blocks in order to provide a manageable datasegment in which to insert watermark data. For example, a digital imagecomprising 1,024×768 pixels may be nominally divided into blocks of64×64 pixels so that the entire image is contained in an array of 16×12image data blocks (a total of 192 data blocks). Different watermark datamay then be inserted into each data block, so that the watermark data isspread over the entire image. For example, the watermark might comprisea 16×12 pixel logo or the like, so that a value representing each pixelof the logo is inserted in a respective data block of the digital image.

Alternatively, the watermark may comprise a text message formed in ASCIIcode and/or binary numbers. A message comprising of 192 bits could beinserted in the digital image if a watermark density of 1/4096 (one bitper 64×64 block) was employed.

The invisibility and robustness of the watermark are aided by dividingthe image into blocks and distributing the watermark data throughout thedata blocks, and are further facilitated by the insertion procedureutilised to insert the watermark data into each data block. Thefollowing acts are used in an illustrative embodiment to insert awatermark data bit or binary pixel graphic into a 64×64 spatial domainluminance data block

(i) Permute the 64×64 data block using a predetermined randompermutation. There exist 4096 factorial different ways in which thispermutation can be performed. To minimise the distortion introduced bythe watermark modification, a permutation can be selected that performsa spectral whitening operation on a signal that has a predominant lowpass power spectral density. The permutation is generated from a keyedpseudo-random operation.

(ii) Transform the permuted data using a Walsh Hadamard Transform. Thistransform can be implemented as a 4096-point one dimensional fasttransform operation.

(iii) Watermark data is inserted into the data block by modification ofselected transform coefficient(s). The coefficient selection process isbased on a keyed-pseudo random operation, and does not include the dccoefficient in set of coefficients available for modification. Tomaximise security of the watermarking process, different coefficientsare selected via the pseudo-random operation for each data block.

A watermark data bit can be represented by the sign of a selectedtransform coefficient. A transform coefficient value greater than orequal to zero could represent logic zero and the negative values logicone. Transform coefficient(s) need only be modified if necessary, toensure that the sign (±) corresponds the digital bit to be embedded(1/0).

(iv) An inverse transform is then applied to reconstruct anapproximation of the original 64×64 spatial domain data block. In thetransform domain, the watermark data is completely contained by onetransform coefficient when using a watermark data density 1/4096. In thespatial domain, however, the watermark data is distributed over each ofthe pixels making up the 64×64 data block.

The watermark read operation is accomplished by repeating acts (i) and(ii) above. The original image or image sequence is not required for thereading operation. The watermark data can be extracted with theknowledge of the permutation applied to the data block, the transformoperation, and which of the transform coefficient(s) modified to containthe watermark data. The permutation employed can be kept secret by theowner of the image or image sequence. The permutation could berepresented by a secret seed number to a well defined pseudo randomnumber generator.

Block transforms such as the classic Walsh Hadarnard Transform (WHT),Discrete Cosine Transform (DCT), Discrete Sine Transform (DST) and theHaar Transform (HT) can be employed in the watermarking process inembodiments of this technology. For transforms that isolate the averageblock value or dc value into one coefficient, that coefficient typicallyshould not be used to contain watermark data. The WHT enjoys lowimplementation complexity. Fast transform implementations of the WHTexist that require only summing and one scaling operation, and thetransform basis vector contains only +1 and −1 elements. The analysisand synthesis transforms are identical.

FIG. 1 illustrates a flow chart of operation involved in insertion ofwatermark data into digital media data, in one exemplary embodiment.Beginning at block 12, the digital media data is first segmented intomanageable data blocks such as blocks of 64×64 pixels or equivalent dataelements. Block 13 calculates the average pixel value for the blockwhich is then subtracted from each pixel. Block 13 is unnecessary whenusing a transform that contains the block average in a single transformcoefficient. This is the case with the WHT and the DCT, for example. Theresulting dc transform coefficient typically is not used to containwatermark data. The media data block or segment is then subjected to apermute operation (block 14) in which the data elements of the block orsegment are rearranged in a pseudo random, but repeatable and reversiblemanner. Next, at block 16, the permuted spatial domain media datasegment is subjected to the transform operation. In this embodiment oneof the transform coefficients is selected and modified to includewatermark data. When watermarking images or image sequences a watermarkdata bit could be represented by the sign of the selected transformcoefficient. A transform coefficient value greater than or equal to zerocould represent logic zero and the negative values logic one.

The watermark data density per block in this case is 1/4096. In someapplications, densities greater than 1/4096 may be required.

Following insertion of the watermark data into the transform domain ofthe media data, the spatial domain media data is then reconstructedthrough blocks 20, 22 and 23 by performing an inverse transformationfollowed by an inverse permute operation and then the previouslysubtracted block average value added to each pixel making up the block.Again, block 23 is not necessary when using a transform that containsthe block average in a single transform coefficient. The resultingdigital media data segment contains watermark data which is robust tomanipulation thereof, secure from unauthorised removal, and yet thereconstructed, watermarked media data is substantially indistinguishablefrom the original spatial domain media data when compared in subjectivequality testing.

In order to extract the watermark data form digital media data in whichwatermark data has been previously inserted, the procedure outlined inthe flow chart of FIG. 2 may be employed. Essentially this involves actsmirroring the first half of the procedure illustrated in FIG. 1. Thedigital media data is first segmented as discussed previously (block32), the average pixel value for that block is determined and subtractedfrom each pixel (block 33) if necessary. The resulting data block isthen subjected to a permute operation as shown at block 34. The permuteoperation must be the same as that performed during insertion of thewatermark data, and thus if different permute operations are variouslyemployed, some record must be maintained of which of the particular 4096factorial permutations applies to the particular media data segment inquestion. This could be in the form of a secret seed to a well definedpseudo random number generator. The permuted media data segment is thentransformed with the same transform used by the insertion operation(block 36). Then it is a simple matter to extract the particularcoefficient for the transform domain media data and then recover fromthis the watermark information.

FIG. 3 illustrates a block diagram of the watermark insertion processdescribed in connection with the flow chart of FIG. 1. As discussedabove, in this embodiment only a single watermark data component, e.g. adata bit or binary graphic pixel, is inserted into each selected digitalmedia data segment or block, and the information required to reconstructan entire watermark requires the examination of a number of digitalmedia data segments.

FIG. 4 is a flow chart illustrating the insertion process of watermarkdata into digital media data, which has been segmented into data blocks,over a series of data blocks. Where the digital media data comprises asequence of images, such as in the case of digital video or the like, acomplete watermark (e.g. the total of the identification data) may infact be distributed over more than one image or image frame. At block 42the first data block in the image or sequence of images is selected and,if necessary, the average of that block is then calculated andsubtracted from each pixel element in block 43. The resulting data blockforming the image segment is subjected to a permute operation, asdescribed hereinabove, at block 44. The permuted image data is thentransformed using a block transform. At block 47 a particular transformcoefficient is selected for possible modification. The selection processis performed in a pseudo random deterministic manner. Transforms thatcontain the block average (dc) in one transform coefficient, or set ofcoefficients, must typically eliminate this coefficient from theselection process. Block 48 performs the modification operation toincorporate the watermark data into the selected transformcoefficient(s). The inverse of the transformation and permute operationsare then applied at blocks 50 and 52 and block 53 adds to each pixelvalue the average as determined in block 43, if necessary. A test isthen applied at block 54 to determine whether the media data hasfinished, and if so the watermarking procedure ends. Otherwise, the nextblock of the digital media data is selected at block 56. The watermarkdata is then incremented, meaning the next component of the watermarkdata, such as the next data bit or binary pixel element, is selected atblock 58. Of course, it will be recognised that it is unnecessary forevery data block of a particular digital media data source to be encodedwith watermark data, and only a certain selection of data blocks may infact be encoded with watermark data in practice. To provide copyrightprotection for the complete image sequence, the watermark can berepeatedly inserted, with the watermark beginning at different framelocations within the sequence and ensuring that watermarks do notoverlap. Of course, acquisition of the signal is important. This can beaccomplished, by incorporating in the watermark data, synchronisationinformation that, once acquired informs the watermark reader thelocation of the beginning of the watermark message data or binarygraphic.

To increase robustness and ensure readability even in the case where theoriginal video signal is significantly changed, such as through reducedspatial resolution or the case where watermarked interlaced material islater converted to non-interlaced format, the watermark can bedistributed across both fields in such a way that the watermark can beindependently read from either or both fields and/or restricted to thelow spatial frequencies. The latter may be accomplished by theapplication of a 2×2 WHT on each row of the image to produce low andhigh spatial frequency components. The watermark is then inserted inonly the half horizontal resolution frame corresponding to the lowspatial frequencies. The full resolution watermarked frame is producedby performing an inverse 2×2 WHT on the rows making up the low spatialfrequency watermarked, half horizontal resolution frame and the originalhigh spatial frequency half horizontal resolution frame.

In order to further improve security of the watermarking procedure, itis possible to alter the permute operation periodically (block 60 inFIG. 4). As mentioned above, it is nevertheless necessary that theparticular permute operation performed on each data block be repeatableat a future time to enable extraction of the watermark.

FIG. 5 illustrates a block diagram of an exemplary watermarkingapparatus for encoding real time video with watermark data. Real timevideo feed is provided to the apparatus at a buffer 80 or the like,which provides an input to real time processing circuitry 82. Thecircuitry 82 may comprise digital processing circuitry in the form ofhigh speed programmable computer circuitry, for example, which carriesout the algorithmic acts described in connection with FIG. 4, forexample. The watermark data is provided from a buffer 84 which may be inthe form, for example, of a ring buffer which cyclically feeds watermarkdata being a component of watermark text or graphic material to theprocessing circuitry 82. The reconstructed video data containing thewatermark data is then passed to an output buffer 86 which provides thevideo data for transmission, recording or whatever function the videodata is required for.

Implementations of this technology, operating in real time, can beutilised to add watermark data to media such as video and/or audioduring live broadcast or other transmission, whilst recording to storagesuch as tape or disc, during broadcast or other transmission fromstorage, and during transferal from one storage device to another, forexample. Furthermore, embodiments operating in real time can be used tomonitor media such as television transmissions to detect the presence ofwatermark data incorporated in the media data. A block diagram of such asystem is illustrated in FIG. 6. Video data is provided to a buffer 90from a source such as a broadcast receiver or the like. Real timeprocessing circuitry 93 is coupled to receive the media data from thebuffer 90 and perform the algorithmic acts described in connection withFIG. 2, for example. This results in the extraction of any watermarkingdata contained in the media data which was inserted according to aprocess known to the monitoring apparatus (i.e. watermark data which hasbeen added with a known permutation and transform in transformcoefficients selected according to a known scheme). A comparisonprocessor 94 can then be used to compare any watermark data which isretrieved with stored watermark data to determine if the retrievedwatermark data corresponds to a known watermark indicating the source ofthe media data.

It will be appreciated from the foregoing description that the originalmedia data is not required by the watermark extraction process in orderto extract the watermark data, and therefore it is not required that theoriginal image be certified by a trusted third party or held in escrowin order to prove the presence of a watermark in the media data. Randomaccessibility of a watermark within an image sequence is easilyachieved, as all that is required to extract the watermark is the imageor sequence of images that contains sufficient watermark data toreconstruct the entire watermark or a substantial portion thereof, andthe secret keys used to seed the random permutation and the randomcoefficient selection process.

Watermarking processes as described herein have been tested on stillimages and image sequences, and have been demonstrated to be nearinvisible to the naked eye in a comparison between the reconstructed,watermarked media data and the original media data. It has also be foundto be secure and robust to compression such as 4 Mbps MPEG coding ofimage sequences and 20% quality setting for JPEG compressed stillimages.

The described watermarking procedure is also robust to digital-to-analogand analog-to-digital conversions. Accordingly, implementations of suchtechnology can be utilised to insert and extract watermark data inanalog media as well as digital media. For example, watermark data canbe inserted and extracted from broadcast or home quality analog ordigital video.

Tests have been performed demonstrating a successful read operation forwatermarked digital video originally of broadcast studio quality whichhas been temporarily recorded on an analog consumer VHS tape. In thecase where the media is generated, stored and/or transmitted in ananalog form, an analog-to-digital conversion using known techniques isused to obtain digital media data before inserting or extracting thewatermark data (see 92 in FIG. 6). The media data may be returned toanalog form, if desired, using known digital-to-analog techniques.

It will also be appreciated that the simple nature of the computationalprocesses involved allow it to be applied quite readily to real timevideo data, for example. This is because the only two computationallycomplex acts in the watermarking procedure, namely the permutation andtransformation are still relatively simple. This makes for awatermarking process that is very low in complexity, is easilyautomated, and requires no human intervention in its application.

The foregoing detailed description has been presented by way of exampleonly, and is not intended to be considered limiting to the arrangementsas defined in the claims.

1. A method comprising: altering, with a computing device, a sign of at least one coefficient associated with data corresponding to audio, image, or video content in accordance with data corresponding to a digital watermark; and prior to the altering, processing, with the computing device, the content data with a pseudo-random permutation function.
 2. The method of claim 1, wherein the data corresponding to the content has a flatter power spectral density following the processing.
 3. The method of claim 1, further comprising transforming the data corresponding to the content to an orthogonal domain before the altering.
 4. The method of claim 3, wherein the transforming comprises transforming with a discrete cosine transform.
 5. The method of claim 1, wherein the altering comprises modifying a sign of at least a portion of the data corresponding to the content.
 6. The method of claim 1, wherein the permuted data comprises a sequence of data, and further comprising selecting certain data in the sequence for alteration based on a keyed function.
 7. The method of claim 1, wherein the processing of the data corresponding to the content with the pseudo-random permutation function is performed by computer circuitry of the computing device.
 8. The method of claim 1, wherein the pseudo-random permutation function comprises a spectral whitening operation.
 9. A method comprising: analyzing, with a computing device, a sign of at least one coefficient associated with content data corresponding to audio, image, or video content to discern whether digital watermark data is encoded therein; and prior to performing the analyzing, applying, with the computing device, a pseudo-random permutation function to the content data to yield permuted content data.
 10. The method of claim 9, wherein the permuted content data has a flatter power spectral density than the content data.
 11. The method of claim 9, wherein the analyzing comprises discerning a sign of at least a portion of the content data.
 12. The method of claim 9, wherein the analyzing proceeds without reference to an unencoded original of the content data.
 13. The method of claim 9, wherein applying the pseudo-random permutation function to the content data is performed by computer circuitry of the computing device.
 14. A method comprising: receiving, with a computing device, data that corresponds to desired audio or visual information; scrambling, using the computing device, the data using a predetermined random permutation, so that the data no longer corresponds to the desired audio or visual information; and performing a watermarking process on the scrambled data by altering a sign of at least one coefficient of the scrambled data.
 15. The method of claim 14, further comprising performing an inverse-scrambling operation on the scrambled data following performance of the watermarking process.
 16. The method of claim 14, wherein the received data corresponds to audio information.
 17. The method of claim 14, wherein the received data corresponds to image information.
 18. The method of claim 17, wherein the received data corresponds to video information.
 19. The method of claim 14, wherein the scrambling or performing the watermarking process is performed by computer circuitry of the computing device.
 20. The method of claim 14, wherein the pseudo-random permutation function comprises a spectral whitening operation.
 21. The method of claim 14, wherein performing the watermarking process on the scrambled data comprises inserting a watermark in areas corresponding to low spatial frequencies.
 22. An apparatus comprising: a scrambler having an input to which content data is applied, and an output to which scrambled content data is provided using a predetermined random permutation; and a processor configured to perform a watermarking operation on the scrambled content data by altering a sign of at least one coefficient of the scrambled data.
 23. A system comprising: a memory configured to store audio, image, or video content; and; a processor operatively coupled to the memory and configured to: alter a sign of at least one coefficient associated with data corresponding to the content in accordance with data corresponding to a digital watermark that represents a message; and prior to the alteration, process the data corresponding to the content with a pseudo-random permutation function.
 24. A system comprising: an input for receiving data that corresponds to desired audio or visual information; means for scrambling the data using a predetermined random permutation so that the data no longer corresponds to the desired audio or visual information; and means for performing a watermarking process on the scrambled data by altering a sign of at least one coefficient of the scrambled data.
 25. A system comprising: a memory configured to store data corresponding to audio, image or video content; and a processor operatively coupled to the memory and configured to: analyze a sign of at least one coefficient associated with the data corresponding to the content to discern whether digital watermark data is encoded therein; and prior to the analysis, apply a pseudo-random permutation function to the content data to yield permuted content data.
 26. A system comprising: means for analyzing a sign of at least one coefficient associated with content data corresponding to audio, image, or video content to discern whether digital watermark data is encoded therein; and means for—prior to the analysis—applying a pseudo-random permutation function to the content data to yield permuted content data. 